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Field testing of the Honey 
!^asureffient and Tiae Program™ was cond4ictad 

classes* of educable mentally handicapped^ (EMH) ^ehildteh. The 
were assigned to the experiaental group, 'the Hawthorn^ g2;oup. 



Onit of ^he Honey, 
with, 23 elesentary school 

210 Ss 
_^ _ or the" 

control group. Two criterion referenced tests were administered to Ss 
to evaluate the effectiveness of the Money Unit 'whick was 'designed as 
a ©ea.ns of concept ^ahd vocabulary development for ^oung handicapped 
learners. Testing demonstrated that the unit significantly increased 
the EMH chil-d's knowledge >of loney skills and vocabulary. The 
effectiveness was indicated by pretes.t' and posttestLgains, by 
perforipance levels on individual ^itess^ and , by retention data. 
Analyses of community location effects showed- that the unit was 
highly effective in rural and suburban communities as well as in the 
'urban cojte^imities, Teachers expressed a preference/ for the unit over 
other instrubtional materials, (GW) ' 
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RESEARCH AND DEVELOPMENT CENTER ' . ' 
IN EDUCATION OB'HANplCAPPED CHILDREN 

Department of Spedal Educatiorf -, 



^ Pattee Hair^Uriiver^lt^^ofMnnesota, Minneapolis, Minnesota 554*55 ' ' ' - 

The Univerjity of Minnesota Researcl), "Deve^ppmen!; and Demonstration' 

- / I , ' Si 

C€P.4:er in^Ediicftion of Handicapped Chfl*ren,has been established to ^ 
concentrate on intervention strategies and materials which develop and * 
\. improve language ^nd communication sHills in yo^ng handicapped childr^en* 
\ Jhe long term objective of the Center is to improve the language 
and' comaunicattcn abilities. of handicapped children by'.means of iden- 
tification of lidguistically and potentially linguis'tically handicapped^' 

children, development and evaluation of intervention strategies with 

^ i ' ' ' • ' -s • ' ' ■ 

yomg ten:dlcapped,chlidE,en and di^sseiiiittition'of findings and products 
• ' > • • , fl*" • ,f ■ . • ■ . • • 

^ of benefit %pyo^g* hffndicapf ek chlidrqrfr^ ^ • ' 
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, I , , Simative Eval\iatlon of the Honey Uttit of tKe ^ • * 

' i • . * ^ . - ■ * ^ \ . , • ^- ' 

" • \ Money , ^Measurement, arid T±m Prograia 

^atric|^'H\* Krus/ ^rtha Thurlow, James E. Jumure/ Arth^ m! Taylor^ 
' * . ^ University of Minnesota \4 - i 



JBv^luation in^d\fcation generally refers to "the collection and ^ 
use of infdnnation-pto -mak^^dedisions about an educftional prograro" . ' 
• CCronbach, 1963). Host attempts at evaluation have accepted this 

definition,* although many have chosen to expand upon it, or to .delimit 

» • ' ' ^ ^> , ' 

.it (cf Dershlmer, 1968)* Scrlven J[196J) hfes inade/a distinction be- ' 

. ' ^ , r * ^ ^ 

%tween *'fonpatifve" evaluation and "suaaaative" evaluation. Formative * 

* ' " %. 

• . - - - ^ * i ^ 
evaluation ±g that which occurs during the development of ^instructional 

materials. One^of its major purposes is to identify ways in which. ^ 

the instruction can be' Improved as It is being developei, Summative 

evaluation refer^s to the ass^s^sment oS ?*final'* instructional 

product .in a. field-test situation* Its major purpose^s to ' evaluate 

the effectivei^ss of the' product in the classroom. 

-Over th^ past two years instructidhal m^erials producefl by the I 

yocabT^f3^ Dev€lopment Prdject of the University of Minnesota^ Research, 

Bevelopmftit an^DesKDnstration Center havQ been subjected. to both' formative 

and^summative evaluations* Jhe mftelrials, referred tu^aslhe Money, a 

■ Measurement and Time Program, were^developed. for educatle mentally 
^ ■ >\ , *^ \ ' ; . 

retarded ims,) children. As each unit in tf\e Pro grin was biing developed, 

it imder^ent an extensive'^fomatl^ve evaluatipn process (cf,, Kru^, 

Thiirl^,, Tuirnure, XajrJ^r, & Howe, 1974). Revisions of all units were 

made on th^iasis of the feedback from the formative evaluations in 



prd^' to prepare them for use In a large-seal^ field-test. The 



summative evaluatljDn^of the units o'ccutred during this field-teit. 

The present paper a. a description o^-the sunsaati^e evaluation 
of the Money Unit, one of the -five * uniti irT thd ^ney^ Ifearsurenient • 



and Time Program, Foinnative evalua'tion of ihe Mo^ey Unit took place 



over a period of one and one-half yearS, and produced ' ^^rev^s^d unit 
which seen^d to be ex'ttemeiy ef fpci:ive for EMR children (Thurlow, Krus/, 
Howe, Taylor, £i^umure> 1^74); X^e riur^ose of the summative evaluation 
of the Money Unift was to te^t the effectiveness of the revised unit 
m\d its useabllity in the classrooia \tJien int^eractions between Project 
. R^sonnel ^d field-test participants^were minimal, . 

The Money ,- Measurement and Tiir^* Program, =^ - -^^^ ' / 

'The Mopey, Measurement and Time Program (Thurlow, Taylor & Turnure, 

1973) is^^ an instructional pcygram designed specifically for young educa- 

» ' » *• ■ 

tionally handicapped leatnara*, The Program includes five units: 1) 

Money, 2) Measurement of Length, 3) Measurianent of Weight, 4) Time wi*th 

\ ' ' / . ' 

the Clock, and 5) Time with the Calendar* Systonatic Instrbctlon is 

provided 'in 'these areas, without requiring that >the children have read- 
ing or computations^{\^skills. ' Further information about tiie specific 
instructional units in the Program is available in the Teacher's 
Ip^troducation to the Program (Thurlow, Taylor h T^rnuire, 1973), 

The Money, Measurement and Time Program was developed from basic 
learning strategies research, such as research on mental imagery and * 
verbal elaboration. It represents one of the first attempts to trans- 
late these recently developed areas of experimental^ research into an 
instructional progr^ /or EMR children* 



The general aljas of the Wtoney, Measurement and Time Program were 
to develop vocabulary and related skills, and f urthe^IK^Te , to promote 
general language .development and the development of effective learning 

strategies. Several specific goals of the Progr^ included: 1) an - 

*. ^ ' ' 

improved understanding oi the critical vocabulary, and thereby better 
understanding of the general area of instruction (money, measurement,^ 
or clme), 2) the developa^nt oJ beginning skills'^in th/e -particular area 
of itistruction, with an emphasis on use of these skills in every-day 
situations,- 3) an increase in general language development, especially^ 
expressive communication, and 4) t&e use of effecient learning and memoi^ 
strategies in any area of instruction* 

Money Unit 

% \ • i ' 

The Money Unit is the largest of the five instructional imi^s in 

the ^ney, Ife^urement, and Time Program* It was developed Jointly 

by educational practitioners and educational^researchers to provide 

aiR children ^i'th an understanding of money and its functions. The 

Unit was first produced in a pilot-test form and, as stated previously, 

underwMt ^tensive formative evaluation and revision (Thurlow, Krus, 

Howe', Taylor, & Turnure, WTA). The revised f orm -wai employed in the 

field^test and subjected to summative evaluation. ^ It is the revised. 

form which- is described here, ^ 

'The Money Unit consists of four books of instruction t^t begin 

by developing a general awar^ess of the fimction and -u^s of money. 

The booka then proceed to teach the recognition of the different 

kinds o£:U,S* money, their relative values, and their exact values. 

f 

Because th€ Program is' designed' to provide instruction that could be 
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applicable to everyday situations, training in countjjig money and 
making change is included in the instruction, as well ,as 4)ractlcal 
applications in store situations. Children may begin instruction 
at various entry points depending on their o^egirming^s kills* In- 
dividually administered assessment instruEian^s are.pfovidffl 
initial diagnostic plac^ent and for determining-^inal^ Achievement , 

The instructional content of the four books of th^ Money Unit was 

written to actress the gradual and closely structured development of 

^\ 

both money vocabulary money sklllsv The vfour books in the Money 
Unit generally represent progressive levels of instruction, fro^the 
lowest to the most advanced. Certain behayloral objectives must be 
mastered before children may progress from one book otf instcuc|:^lon 
to the next book. Thus, depending upon- the ability of the children, 
each book of Instruction cam take from two weeks to several months to 
complete • 

Each book in the Honey Unit is composed of lessons which contain 
Instruction related to one or more vocabulary words. Each lesson is 
associated with specific purposes and beha^brai objectives. The 
lessons within a book are ^arefully ordered with behavioral objectives 
in one lesson being requisite for adequate performance in later lessons • 
A lesson, which often requii^es several periods of instruction, includes 
three major components: 1) pre-activities which introduce the concepts 
or review the meaning of necessary prerequisite concepts ^ 2) tape 
presentations which develop the meaning of vocabulary words and the 
relations between words p and 3) post-activities which review and rein- 
"force the concepts and relations established in the tape presentation. 



The Summatlye Evaluation Plan ; S \ 

Bec^uaa df tiiite 'and budget restrictions, the desired field- 
plan, in v^icK classes would be allowed to spend at least one year 
progressing through the Instruction in the. Money (uhit, could not be 



- \ 

ad*-test\ 



implemented; . Instead,^ the field-test of the Money Unit vas gombinptd 
with the field-t^st of the Time with the Clock Unit,/ This meant 

4 -3 

that, except for a few classes, instruction in the Money Unit was 
sjtopped af tet three to four months so that the meld-test of the. Time 



with the Clock Unit could be started in the same classes, la •'the 

few exceptional cases, classes'continued with the Money Unit instruction 

until the end of the year (i.e., a total instructional period of four 

^ " ^ \ 

to five months), without receiviug instruction in any other unit, A 

similar plan was used to test the Measurement of Length and Measurement 
of Weiglit Units, 



Method 



Design 

, For the summatiye evaluation of the Money Unit, a two factor 
design (Treatment .X ConasunityJ was employed. ^ The major factor of 
interest was the Instructional treatment^ factor. The tt^ee treatments 
in the present design were: 1) Experimental, 2) Hawthorne, and 3) , ' 
Control, 

. The Experimental treatment group :^epresented those classes /re - 
celving the Money instructional program," These classes did not re- t 
ceive any supplemental im>ney instruction* 

The Hawthorne treatment group consisted of classes receiving iii- 
struct ion in the Measurement of Length Unit from the Money, Measurement 
and Tljne Frograa* The Hawthorne group was inciiide'd in the design as one 



type of control. ^ Gains on the Money tests by this grqup would repre- 
sent changes In performance one could expect from the "novelty" ot .1 
new program in the classroom, Interactions with testers, "learning -to- 
learn," and several other related factors. To conclude .that* the Honey 
Unit instruction itself contributed significantly to performance in- 
creases, one must discover that the Experimental group performed ^ 
significantly better than the Hawthorne control erouD* 

The Control treatment group represented those classes where teache 
were left^ on their own, either to teach or to not teach money concepts. 
When these teachers chose to' teach money, they were allowed to use any 
materials available to them,(e,g., published materials, teacher- 
deveJoped materials, etc*), but they were not 'allowed to use the Money 
Unit^from the Money, Measuresientr and Tit^e Program* 

The second f^tor In the design was that of\conmiunity location 
(urban,' rural, or suburban). Urban communities Included three of the 
four major cities in Minnesota. Suburban communities were classified 
as those which immediately adjoined these cities, and which were called 
"suburbs" by the communities themselves* Rural communities included 
those not covered by the above classification systems. It should be 
pointed out, however, that the conmiunities labeled as "rural" for 'this 
investigation may be som^^.what different from, the usual conception of 
"rural". For instance, there were two colleges in one of the rural 
communities, and x)ne in anothA:* Also, it was noted that many academic 
and professional people lived in some of the "rural" areas and coimnuted 
to work in a nearby urban coimnunity. Communities categorized in this 
manner, however, concurred with the categorization scheme of the Minn- 
esota Department of Educatidn, 



Subje' ct_ q , . . . r ' 

Tne population employed for field-testing during the suinmative 
evaluation was elementary school-aged educable mentally retarded chil-- 
dren* , Of the 23 classes employed during the presented field-test, 
eight classes (2 urban, 3 ^utal, and, 3 suburban) were chosen to be 
in the Experijnental treatment (x,e,, they r4ceived instruction from* 
the Honey Unit), eight classes (2 urban, 3 rural, and 3 suburban) 
were included in the Hawthorne control treatment (i,e,, they received 
instruction in the Measurement of Length Unit), and sever classes 
(2 urban, 2 rural, and 3 suburban) wdre included in the Control 
treratmen£ (i,e., they recieved instr'iiction from any source other 
than the Honey Unit, if the teacher chose to give it to them). 
Assignment of the classes to treatments was mad^^ 'so thai the lower 
functioning classes were included in the Hawthorne group* This was 
done so that some classes would enter the instruction at the beginning 
of the Measurment of Length Unitj which was considered to provide 
instruction on especially low-level concepts* 

Overall, there were 71 children (15 urban, 31 rural, and 25 
suburban) in the iilxperimental group, 69 (16 urban, 24 rural , and 29 
Suburban) in the Hawthorne group, and 70 (16 urban, 23 rural, and 
31 suburban) in the Control group* It should be noted, however, that 
the specific nmabers of children for, whom data from specific tests 
were available varied due to testing procedures (see below) and 
absenteeism* 
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A summary of the children's IQs, niental ages (MAs) and chrono- 
logical ages (CAs) In the three treatinent groups is presented in Table 
1, along with the results of a one-way factorial analysis on each 
measure. Again, it should be noted that the number of subjects some- 
times varied with the measure due to incomplete test data. Clearly, 
the three groups did differ significantly in IQ level and HA level. 
A. Hewman-Keuls test for differences between the IQ means indicated that 
the Control group had a significantly higher IQ than the Hawthorne 
group (p ' -01) and that the Experin?ental group also had at significantly 
higher IQ than the Hawthorne group < .05), The Experimental and 
Control groups did not differ* A Newman-Keuls test on the MA means 
similarly revealed that both the Control (e, < ,01) and Experimental 
(p. < .05) groups had higher MAs than the Hawthorne group. The Experi- 
mental and Control groups did not differ significantly^. 

Table 2 presents the IQ, MA, and OA data arranged' according to 
community location. One-way factorial analyseo revealed a significant 
'effect of community location for each measure. N^wman-Keuls tests for 
differences indicated that children in both the rural and urban comasuni- 
ties had significantly higher mean CAs and MAs than those in the subur- 
ban community (all £S < .01), with the rurals also significantly 
higher than the urbane in terms of MA level (^j < .01) . In terms of 
mean IQs, the suburban < .01) and the rural < *05) coiranunities 
were higher than the urban community. 

Tea ts 

'^o criterion-referenced tests were administered to the children 



Table 1 

i 

Comparisons Between the Three Treatment Groups on 
IQ, MA, and CA 



I'Q 



X 
SD 
Range 
n 

MA (months) 
X 
SD 
Range 



Experimental 

72.3- 
8.1 
47-89 
71 



CA (months) 
X 
SD 
Range 



77.1 
10.6 
47-105 
71 



106.5 
13.9 
81-136 
71 



Hawthorne 

68.7 
9.7 
47-89 
64 



69.6 
14.8 
40-108 
65 



99.3 
21.8 
63-145 
69 



Control 

74. S 
9.4 
56-93 
64 



78.3 
14.5 
55-118 
64 



104.0 
19.3 
75-142 
70 



7.51 
<^ - .001) 



6.32 
(£. < .005) 



2.70 
ins) 
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Table 2 

CoHparlsons Between the Three Conmunity 





Locations 


on ,IQ, MA, 


and CA 






^ Urban 


- 

Rural 


- 

Suburban 


! F 


IQ 










X 


68*4 


71.7 


74.1 


I 


SD 


9.6 


8.4 


9.6 


1 5.59 


Range 


47-85 


/ 49-88 


47-93 


! . (p < .005 


n 


44 . 


76 


79 


i 


MA (Mtiths) 










X 


75. 8_ 


81,. 4 


58.8 


j 


SD 


11,5 


13.3 


12.5 


! 19.00 


Range" 


50-103 


40-118 


41-105 


1 (p < .001) 


n 




' lb 


s 

OA 

au 


j 


CA (aKDHths) 






^ r 

1 






111.2 

f 


112.6 


90.7 




SD 


15.6 


16.8 


14.3 


i i»7.99 


Range 


78-144 - 


78-145 


63-121 


i (p < .001) 


n 


47 


78 


85 
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to determine the effectiveness of the Honey Unit instruction. Each 
test was atNinisterad as a pretest, and at the same time, to deter- 
mine the pis* " ' ' of ? class within tua sequence of ' instruction* The 
same tests ^ ^ administered as posttests after Experimental group 
instruction in, the Unit was stopped • 

The Mon gy_ Slcill s Test was a twenty item test designed to determine 
the child's functional uniarstanding of money and money skills. It 
consisted of five subtests which evaluated skills ranging from simple 
recognition to counting money* The test was admlnis tiered to all children 
(except, of course, those who were absent, etc). 

The Mone y Expressive Test was a twenty^ item test designed primarily 
to evaiua|;e the child's ability to utilize specific vocabulary words. 
It consisted of four subtests which corresponded to the four in- 
structional books of the Money Unit* This test was administered to 
only one-half of the children in each class in the present field-test* 
Administration was made randomly* The decision to reduce the data on 
this test was made in light of the excessive testing burdens put upon 
the classrooms and children participating in the field-test* 

A Cognitive Abilities Test (Thorndike, Hagen, & Lorge, 1968) was 
also administered to the children particpating in the present field'-t^st. 
Since this test was employed to evaluate the child *s general improvement, 
in non-content-specific areas of cognitive functioning after a full year 
of instruction in the Money, Measurement and Time Program, the results 
of ^ this test will not be described here. 

Procedure 

VfiB field'-test of the Money Unit was conducted over a period of 
three to five months. The goal of this field-test was to assess the 

I 



Unit under relatively ^'normal" classroom conditions, with minimal 
interaction between Project personnel and field-teat participants. 

Before instruction was started, children In each class were pre- 
tested on the Money Unit tests (Skills and Expressive"* and the Cognitive 
Abilities Test. Then, each teacher in the Experimental treatment group 
attended a brief in-service training session designed to introduce the 
Money, Measurement and Time Program, the field-te-^^t plan, and specifi- 
cally, the Honey Unit, Interactions with the classes stopped at this 
point (except for ^'comment cards" returned to Project Directors when 
the teachers felt comments were necessary), until posttesting time 

After instruction ended, classes were posttested on the 
Money Unit tests, (The Cognitive Abilities Test was administered at cKfe 
end of the year.) At t^is point. Experimental teachers were requested to 
complete a detailed questionnaire on their reactions to the UMx, and 
to the Program in general. Control teachers were also asked to describe 
any instruction related to money that they had used during the same period* 

Approximately two months after Honey Unit instruction had been 
stopped, a rc^ndom sample of children who had rece:?ved the instruction 
were retested on the Money Skills Test and the Money Expressive Test, 
llie purpose of this retesting was to obtain a measure of content reten- 
*'ion. 

Results 

The amount of data collected during the sunmiative evaluation of 
the Money Unit was massive. T\ie major sources of effectiveness data 
were the results of the pretesting and the posttesting* Because of 



absenteeism, testing procedures, school schedules, e<-c* , only a limited 
number of the children participating in the field-test received both 
the pretests and the posttests for the Money Unit. In order to bene- 
fit from the larger n's or the total sample receiving the instruction > 
it was decided that all pretest data and all posttest data would be 
analysed, even though exactly ^t he same children were not in each sample^ 
These results are presented in two sections: 1) Pretest comparisons, 
and 2) Posttest comparisons. Although based on a reduced sample size, 
the pretest to posttest comparisons p'-esented next in the Results / 
section are probably most reliable. These reflect the data of just those 
children who were pretested and posttcsted on the same measure.- 

Data relating to the performances of the three treatment groups 
on individual test items will also be presented. These data not only 
provide further effectiveness information^ but also have the potential 
for identifying possible areas where revision of the instruction shoulH 
be undertaken » ^ 

The Results section will concludt. with three additional sets of 
results. These results deal with: 1) Comnunity location ccfcipatisons, 
2) Retention findings, and 3) Feedback from teacher: ev,aluations. 

Pretest Comparisons 

In order to compare ziie posttest results of the three treatment 
groups (and so, assess the effectiveness of the Money Unit), the pre- 
test scores on the two Honey Tests must first be compared to show that 
there were no differences between the three tr^eatment groups before 
instruction* Table 3 presents the means and standard deviations of 
the pretest scores on the Money Skill*=^ and Money Expressive tests, 
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Table 3 

Comparisons of T^ree Treaticent Groups on 
Money Skills and Money Expressive Pretestrs 



Money Skills Test (20 items) 

Experimental Hawthorne Control 
X 4,56 ' 2\76 4.53 
>SD 4.61 4*26 5.00 
n 71 43 45 



ijoney Expressive Teut (20 items) 

Exppriffiantal Hawthoime Control 
X 9.19 5.30 7.82 

SD 3.87 4.21 4.92 

n 36 30 ' 34 
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and the results of a one-*way "^nova for each test. 

There were no significant differences between the treatment groups 
on the Money Skills pretest. However, there were significant differ- 
ences on the Money Expressive pretest, where the Hawthorne group sub* 
jects scored significantly below the other two groups (NewmaFl-^Keuls 
test, p_ <,05). . The low scores of the Hawthorne subjects perhaps re-- 
fleet their lover mean IQ and MA levels* There was no statistical 
difference between the Experimental group and the Control group on 
either pretest, TJie finding of a significant difference between the. 
Hawthorne group and the Experimental and Control groups on the Expressive.^ 
test necessarily restricts the conclusions vhJch can be drawn from 
posttest differences on the Money Expressive Test . 

Fostteat Coap arlsons 

Tlie means and standard deviations of uhe posttest scores on the 

Money Skills and Money Expressive tests ^ and the results of a one«-way 

anova for each test are presented in Table 4* Analysis of variance 

/ * - 

i >■ ^ 

techniques and follpw-^up tests applied to these posttest scores showed 
that the Experimental group scored significantly higher on both Money 
tests than the other two groups. Contrasts between the groups indicated 
the same patteni of results. Specifically, the Experimental group 
scored significantly higher than the Hawthome group ( t^ = 4*1, £ ^.001) 
and the Control group ( t_ = 2.1, p < ,05) when taken separately or when 
cc^pared to the average of the two groups ( t^ - 4,0, £ < .001). Also, 
there were no significant differences between the Hawthorne group and the 
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' Table 4 

Comparisons of Three Ttreatmnt^ Groups on 
Money Skills and l^ney Expressive Pcsttests 



Honey Skills Test (20 items) 
Experimeatal 
X • 10,63^ 
SD 4.94 
n 70 



J^Wtl yn ie 
5.24 
6. -36 

■ 29 



Control 
■ 7.77 
6.72 
31 



Money Express ive Test (20 Items) 





Experimental 


Hawthorne 


J-^ Control 


X 


13.43 


7,42 


9.90 ■ 


SD 


3.9| ; 


" 5.00.^ 


i 5.39 


n 


ho' 


31v ' 


31 








/ 

■ -. / 



Control group (t - 1,5), 

The results of the Honey Skills posttest thus seeia to clearly 
indicate the effectiveness of the Money Unit, since no differences 
existed between groupr on the test at pretest time. The posttest 
results from the Expressive test must be coasldered more carefully, 
however, since pretest; differences did exist, - Clearly, however, tl\e 
Money Expressive pos;&test dif f eren<te^ are of a greater magnitude and 
^include a difference between Eb^eri^mtals and Controls which was ^ 
not found on the pretest. 

\ r 

Pretest to Posttest Comjiaifiscms ' ^ i - ' ' ."^^ 

In oTrder- to avoid sob^ of- the limitations of analyzing all pre- 
test and all posttest data separately, without recognizing that all " 
children were hot both pretested and posttested, a repeated measures 
analysis of variance for each Honey test , was conducted* Foi^theae 
analyses, the only subjects.jUSed were thote f or^ whom both pretext and 
posttest ^data were available. ,0f course, this pi^ocedure resulted in 
a significant decrease in the nianberi of children assessed. Consequently, 
the means and standard deviations- t&ee Tables 5 and 6) are also some- 
what different than those presented in Tables 3 and 4, 

r 

Tne^two'-way repeated n^asures anafysls of variance of the Honey 

Skills data revealed significant differences between the treatment /groups 

between, pretests and posttests, and a islgnif ikant treatment by test 

Interaction (see Table 5). Tlie pretest to posttest. achievement levels 

^, * t 

for each tT^atment group are presented! in Figure 1. T^osthoc comparisons 

of * the Hohey Skills e^ans showed that while the'pretest scores of the' 
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Table 5 ^ 

. Pretest to Posttest Comparisoa of Subjects 
Receiving both ?re and Post Money Skills Tests' 



Money Skills ^Performanc es 
Experimental 



Hawthorne 



Control 





Pre 


Post 


Pre 


Post 


' Pre 


Post 


X 


4.73 


10.64 


2.96 


4.46 


5.43 


6.93 


SD 


4.66 


4.99 


4.37 


5.62 


5.74 


6.45 


* n 


64 


64 


24 


24 


28 


28 



Two-way Repeated Measures AHOVA 

Sourer of Variance 



Between Ss 
Treatment 
Error ' 

Within Ss 

Tests (Pre, Post) 
Treat. X Test 
Error 



df 
115 
2 

113 

116 
1 
2 

113 



280.18 



50.10 



896.28 
124.25 

5.16^ 



5.59 



173.70 
24.80 



p < .005 



P < .001 
p < .001 



\ 
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three groups were not significantly different, the posttest score 
for the Experimental group was significantly higher than either the 
Control or the Hawthorne group* The interaction was explained by the 
large pretest to posttest change in the Experimental group. 

The two-way repeated measures analysis of variance of the Money 
Expressive data revealed the same signicant differences as for the 
Money Skills test (see T^le 6) ♦ The pretest to posttest achievement 
levels for each treatment group on the Honey Expressive Test are pre- 
sented in Figure 2, Posthoc comparisons on these means again showed 
no pretest differences, but a strong statistical difference between 
the Experimental group and the Hawthorne group was found at posttest. 
The difference from pretest to posttest was significant for the, ^ . 
Experimental group only. 
Item Analyses ^ 

The Money Skills and Expressive tests were criterion referenced 
tests, with items directly related to the behavioral objectives of the 
instruction. Table 7 presents the pretest and posttest percent 
correct figures by test Items £or the Experimental treatment group 
on the two Money tests* The Experimental group has been subdivided into 
four groups which receiyed differing amotmts of Honey instruction. 
In this table, the items from the two tests have been integrated and 
grouped according to where instruction related to the items appears 
in the Unit, 

Observation of Table 7 indicates that for alim>st every item, the 
Experimental subgroups show a marked increase in pretest to posttest 
^performance when they had received the relevant instruction. Almost 
all of the children knew the definition of a penny, and most recogni::ed 
and labeled the other common coins. 
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Table 6 

Pretest to Posttest Comparisons of Subjects 
Receiving both Pre and Post Honey Expressive Tests 



Money Expressive Perfonnances 

jerimental 



Hawthorne 



Control 





Pre 


Post 


Pre 


Post 


Pre 


Post 


X 


9,09 


14.33 


4.60 


5.70 


8.42 


9.83 


SD 


3.92 


3.39 


4.81 


4.30 


5.37 


5.62 


n 


33 


33 


10 


10 ■ 


24 


24 



f 

Two-way Repeated Measure'^ ANOVA 
Source of Variance 



Between S^s 
Treatment 
Error 

Within Ss 

Tests (Pre, Post) 
Treat. X Test 
Error 



df 
66 
2 
64 

67 
1 
2 

64 



MS 

347.96 
36.94 



354.66 
64.48 
4.08 



9.42 



86.93 
15. SO 



p < .001 



p_ < .001 
p < .001 



achlev^ent level tha Money Expressive pretest and polttest for each tti^atment group, 



(14,33) 



Experimental 



Hawthorne 



(9.83) 



-• Control 



(5.70) 



(4.60) 



POST 



P.,rcent £xperfeentals Responding Correctly on Individual Items 
by Vheve Instruction was Stopped 



»c<^lnnln<^ to Book 2. le s son 7 

' » r>£3crib€S trading situation 

States •V.onev" '^-'hen related to store 
Selects pictures of «oney 
States "save** in response to definition 
Labels a nickel 
' States "penny" in response to definition 
States ''dice'* in response to definition 
Selects diae as coin that buys tsost 
Selects pictures of half dollar 
Tot«l nuobcrs coins knovn 
Orders 5 coins by value 
Selects coins buying more nickel 



Book 2j_ lesson 7 zo Book 3, Lesson 7 

Describes why fake bill not real 
States "bill" labeling 20 dollar 
Selects picture of 5 dollar bill 
States "fifty dollar bili" 
Labels shopper as "cuscotaer" 
Labels a cash register 
Describes relative buying of quarter 
States penny as "one cent" \^ 
Reads 5C 

Changes nickel for 5 pennies 
Responds "change" to definition/5^ 
States "d«j€" is 10 pennies 
States "quarner" Is "25 cents" 
States "50 pent^ies In half dollar*' 
States "50 cent piece" 



Book 3, legson 7 to Book 3, End 

States dollar is "100 cents" 
c l^eads $2^ 
Reads $2.30 

States 10 dollar bill " 2 fives 
Correct count - 5 nickels 
Counts conibinations of coins (20c) 
• Counts sills and coins (Sfc32) 
Counts H bill and coins fl2.35) 



look 3, End to Book End 

Labels price tag 

States that cash Is taoney 

Labels "check'' 

States "change to definition 
Hakes chauge 12c fron quarter 



58 
69 
7 
A2 
67 
64 
42 
31 
44 
23 
23 
24 



67 
64 
45 

3 
33 
58 
54 

. 81 

13 
14 
28 



9 
50 
31 

6 

XI 
17 
10 
7 



33 
58 
39 
33 
0 



Bk 2 


Bk 


3 


Bk 


3 


Bk 


4 


L7 




L7 


End 


End 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 




75 


75 


85 


40 


83 


57 


100 




75 


67 


76 


60 


94 


78 


85 


0 


0 


0 


33 


16 


56 


8 


26 




50 


50 


67 


20 


72 


50 


78 


50 


50 


54 


90 


53 


94 


92 


89 




75 


67 


90 


4C 


100 


78 


IQO 




50 


42 


76 


20 


83 


57 


<3^ 


25 


25 


27 


62 


32 


83 


36 


70 


0 


50 


27 


95 


58 


94 


56 


100 




50 


42 ^ 




40 


94 


50 


85 


0 


25 


14 


33 


37 


83 


24 


74 


25 


0 


9 


48 


32 


72 


32 


67 


EKDED 














IHSTRUCTION 












- 


50 


58 


67 


70 


83 


64 


74 




25 


58 


86 


60 


83 


71 


96 


25 


50 


27 


95 


63 


q4 


52 


92 


25 


75 


36 


71 


42 


83 


36 


39 




50 


' 0 


0 


0 


50 


7 


33 




j\j 


17 


43 


20 


83 


57 


85 




75 


50 


76 


50 


78 


71 


81 


50 


75 


41 


76 


63 


100 


' 60 


81 




75 


75 


71 


80 


89 


85 


92 


0 


25 


14 


33 


32 


83 


36 


63 




25 


0 


10 


20 


50 


7 


30 


0 


50 


9 


43 


10 


89 


24 


59 


0 


25 


0 


19 


16 


78 


24 


81 


0 


0 


4 


24 


16 


72 


24 


70 




0 


17 


10 


40 


72 


28 


78 






EHDED 














INSTRUCTIOH 








0 


0 


4 


14 


I 


56 


12 


59 




0 


42 


67 


1 30 


61 


71 


74 




0 


17 


28 


20 


72 


50 


63 


0 


0 


0 


* 5 


16 


33 


4 


26 


0 


0 


4 


14 


16 


61 


16 


56- 


0 


0 


4 


14 


21 


56- 


28 


33 


0 


0 


4 


0 


10 


33 


16 


26 ' 


0 


0 


0 


5 


5 


22 


16 


22 










ENDED 














INSTRUCTION* 






50 


42 


24 


20 


44 


36 


56 




50 


92 


71 


30 


56 


50 


78 




50 


33 


48 


30 


72 


50 


81 




0 


33 


iO 


40 


50 


28 


44 


0 


0 


0 


0 


0 


6 


0 


4 














ENDED 
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One group of Experimental subjects ended instruction at Book 2, 
Lesson 7, the first grouping of Items. Yet in the second grouping, 
they showed improvement |on items covering instruction they had not 
received. This phenomenon is also evident in the next two Experimental 
subgroups who did not complete all of the instruction. Such findings 
imply that the instruction results in some generalized transfer, 
facilitation, or learning-'to-learn factor. In other words, instruction 
on even part of the content of the Honey Unit resulted in the acquisi- 
tion of additional objectives. 

Table 8 presents the same breakdown of test items as Table 7, 
but presents the percentages of Experimental ^ Hawthorne , and Control 
subjects responding correctly to each item. In addition, for the Exper- 
imental group, it distinguishes between the percentages for these who 
received the instruction and those who did not* Clearly, when the 
performance of those children received the instruction in the Money 
Unit is compared with that of children who did not receive instruction 
(Hawthornes, Controls, and Experii^ntals who did not receive instruction), 
differences are evident* 

In general J Table 8 also reveals that the Control subjects tended 
to perform better than the Hawthorne subjects* Due to the confounding 
from HA and IQ characteristics of the subjects (i.e., Hawthornes were 
significantly lower on these two measures than the other two groups). 
It is difficult to determine whether or not any actual **Hawthorne'^ 
effects occurred in the present study. However, there was transfer in 
the Experis^ntal group, where instruction in one part of the Money Unit 
resulted in better performance on objectives frosi material not yet 
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Table 8 

Per Cent Responding Correctly In Each Treatment Grout* 
on Individual Items 



ExperlBientals 
Overall 



Lxpc^rimentals 
Receiving 
In^tructi^on 



Experieiencals 
Not Receiving 
Instruction 



Hawthorne Control 



Beginning to Book to, s son 7 

Describes trading situation 

States "money" when related to store 

Selects pictures of money 

States "save" in response to definition 

Labels a nickel 

States ''penny" in response to definition 

States "dime" in response to definition 

Selects dime as coin that buys most 

Selects picture:? of half dollar 

Total nuLibera coins known 

Orders 5 coins by value 

Selects coins buying more nickel 

Book 2, lesson 7 to Book 3, Lesson 7 



IHJScribes why fake bill not real 
States "bill" labeling 20 doUar 
Selects picture of 5 dollar bill 
States "fifty dollar bill" 
Labels shopper as "customer" 
Labels a cash register 
0«ecribes r*;latlvc buying of quarter 
States penny as "one cent" 
Reads 5^ 

Changes nickel for 5 pennies 
Responds "cnange" to dcf inition/5^ 
States "dime" is 10 pennies 
States "quarter" is "25 cents" 
States "50 pennies In half dollar'* 
States "50 cent piece" 

Sook 3, Lesson 7 to Book 3> £nd^ 

States dollar is "100 ceJits" 
Reads J2 
Reads $2.30 

States 10 dollar bill - 2 fives 
Correct count ~ 5 nickels 
Counts coffibir.ations of coins <20C) 
Counts bills and coins ($2,32) 
Counts $1 bill and coins ($2.35) 



Book 3. 



to Book 



Labels price tag 

States that cash is money 

Labels "cneck" 

States "change" to definition 
Hakes change 12c from quarter 



90 
S4 
54 

68 
96 
81 
68 
94 
88 
61 
51 



73 
86 
9i 
81 
28 
78 
78 
84 
84 
57 
28 
70 
58 
53 
31 



41 
64 
51 
20 
41 
31 
18 
16 



43 
68 
67 
33 
3 



90 
84 
34 
71 
88 
96 
81 
68 
94 
88 
61 
51 



<H-66) 
74 
89 
94 
82 
27 
60 
79 
85 
85 
59 
29 
71 
61 
56 
54 



{H-45) 
58 
69 
67 
29 
58 
42 
29 
22 



/*";^27) 
56 
7S 
81 
*U 
4 



(N-4) 

^^0 
25 
50 
75 
50 
■ 50 
75 
75 
. 75 
25 
25 
50 
25 
0 
0 



(N-25) 
12 
56 
24 

4 
12 
12 

0 

4 



<H-43) 
35 
63 
58 
26 
2 



42 
71 
10 
42 
62 
52 
35 
31 
38 
39 
28 
24 



52 
61 
45 
41 

0 
32 
48 
41 
61 
24 

3 
24 
21 
14 
16 



17 
29 
22 
21 
21 
24 
10 
10 



13 
58 
48 
10 
14 



48 
74 
26 
64 
71 
64 
58 
42 
68 
64 
35 
39 



61 
64 
77 
74 
3 
42 
77 
55 
71 
32 
13 
39 
29 
26 
32 



29 
48 
45 
26 
26 
39 
16 
19 



19 
55 
52 
26 
29 
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presented. Such a finding would indicate that there are potential 
transfer or leartilng-to-learn effects from the instruction in the 
Money J Measur Client and Tiisa Program* r 

Comtrnmitx Locatit>n Cocjpartsons 

During the stage of formative evaluation, the Money Unit waa..^ 
written by teachers who had taught in ai^wurban coinmunity and was pilot- 
tested with urban EMR children. To check the general effectiveness 
of the ^foney Unit for different types of consnunities , comparisons of 
results by location Ver^ - made* 

Table 9 presents the Money Skills posttest performance data for 
^he three treatment groups' when further defined in terms of cosmiunity 
location. Results of the one-way analysis of variance carried out on 
each treatB^nt group are also presented. Similar data for the Money 
Expressive Test are presented in Table 10, 

Generally* the rural children scored higher than their suburban 
and urban counterparts. This difference was significant for Experi- 
TCntals and Controls on the Skills test and for Controls on the Expressive 
test* lliese differences may be due to the different ability levels of 
children placed in special^ class in these communities, ^d very likely is 
related to the MA and CA differences found between groups, Tlie Honey Unit 
appears to have been particularly efficacious for the suburban children* 
If It can be assus^d that the scores of the Control and Hawthorne groups 
are those that the Ejq>erin^ntals would have achieved without instruction, 
then the suburban Ebcperioientals tripled their knowledge of money skills 
and more than doubled their expressive ability. For the urban children, 



\ Table 9 



Comparisons of Money Skills Posttest Data for the Three' 
Community Locations in each Treatment Group 



Experimentf^l 
X 
SD 
n 

Hawthorn^ * 
-< X 
SD 
n 



Control 



X 
SD 
n 



Urban 

8.9 
5.2 

16 



4.8 
4.7 

5 



7.0 
7.5 
6 



Ryral 

12.4 
5,0 
29 



8.5 
8-. 2 
11 



13.3 
6.0 
12 



Suburban 

'9.7 
4.3 
25 



2.7 
3.8 
13 



3.1 
1.9 
13 



3.31 
(£ < .05) 



2.76 
(ns) 



12.91 
(£ < .001) 
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Table 10 . 

Comparisons of Monay Expressive Posttest Data for 
the Three Community Locations in each Treatment Group 



Experimental 
X 
SD 
a 



Urban 

12,3 
4.2 

16 



Rural 

13,7 
3,7 
29 



Suburban 

W.7 
4.2 

36 



< 1 
(ns) 



Hawthorne 



X 
SD 
n 



6.2 
4.0 
9 



8.0 
4.0 
10 



7.7 
6.6 

12 



< 1 
(ns) 



Control 



X 
SD 



9.5 
5.3 
6 



13.4 
4.9 
12 



6.9 
4.1 



^ 6.31 
(£ < .01) 
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the Experimental group scored better than the other two groups, 
p^ticularly in the expressive area. In the rural coimnuniti,es , where 
all of the groups appear to have better money skills and expressive 
abilities, the Experimental subjects scored much better than the 
Hawthorne, but not statistically different from the Controls* 



Retention 

One of 'the aims of the developers of the Money^ y^i^ was to pro- 
auce materials whicn would result in relatively "permanent" increases 
in tne tLm child's ability to talk abo.ut and deal with mone^^ lo' 
test for long term retention, the Money Skills and bxpressivJ te%ts^ , 
were readministered to Experimental subjects two months after In- 
struction in the Money Unit had been stopped. 

Forty-six children in tae Experimental treatment group were 
given tae retention test. These cnildren were from the fiv<t^classes 
in which instruction in the Money Unit was stopped, (The cnildren in 
the tnree ibxperimental classes that continued instruction tnrough the 
end of tne y^ar were not given retention testing*) ^0 

Both the post test and long term retention data are presented in 
Table 11 • These data indicated that after two months, the hxp^ -imental 
children haH not forgotten what they had learned about money* In fact, 
their mean scores had actually increased, although the increases were 
not statistically significant* What is significart is the fact that 
the EMH youngsters, exposed to the Money Unit for only a few months, had 
more tUan doubled their knowledge of money skills and vocabulary and 
had retained this knowledge as long as two months. 
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, , * ' Table 11 

Money Skills and Expressive Test Scores for Experimental 
Subjects at Posttestlag and Two Months Later (Retention) 



- • ^ ^ioaJttfiat Retention 

ttoney Skills Test (20 items) 

'x . 10.6 11.2 

SD 4.9 5.2 

n 70 46 

1 



Money Expressive Te&t <20 items) 

X • 13.4 14,6 

r 

SD 4.0 3.3 

n 70 46 
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Teacher Evaluation of the Money Unit 

All of the Experimental group teachers answeicd a questlonn^re 
about the Money Unit* (See Appendix 1 for a copy of the questloqnalre. ) 
The number of years of teaching experience these teachers had varied 
from one to 25, with a mean of 7,2 years and a standard deviation of 
6.7 years. The number of years teaching handicapped children ranged 
from less than one year up to 18 years (X * 5»4 years, SD =^ 5,4), All 
teachers were certified in special education. 

On the evaluation forms, the teachers Indicated that the mean 
preparation time for each teaching period was about 15 minutf^s. The 
average length of each teaching period was 25 minutes, and the unit was 
generally taught every day of the week. The room arrangement preferred 
by most teachers was one where the teacher, tape recorder, and book 
were in the center, with the children on the floor around them* 

All of the teachers enjoyed using the Money Unit and would use it 
rather than another money instructional package when they teach money 
again. Most of the teachers (70X) felt the materials offered 
mox;e diversity than mos'^t other materials and none reported getting tired 
of teaching with the materials* In general, all of the teachers thought 
the Money Unit was more useable, effective, and enjoyable than other 
commercial materials they had used. Seventy per cent of the teachers 
felt that all of the concepts covered In the Money Unit were important 
to children in thf long run, and the rest ot the teachers reported that 
most of the concepts were necessary. All teachers felt the children 
would remember the more important money concepts a year from the time 

i ' I 
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they learned them. All of the teachers reported that the materials were 
either "effective" or *Very effective," They thought that 90 % of 
the , children were more interested in the instruction in the Honey Unit 
tharf they had been in t)ther instruction, 

,The teachers did make some recommendations on their evaluation 
forms. While 80 % felt that the Unit was coicplete as it is , 20% 
requested more instruction at the end of the Unit (i,e»» instruc- 
deall«% with counting money and with making change). Most of • 
the teachers requested that tests of the children's progress be inserted 
into the instruction at the end of key lessons or at the ^nd of each 
book. 

Other teacher reactions to the instruction and a surnmary of the 
data are available in Appendix 2. 

V 

Sumaary 

The suBinatlve evaluation of the Honey Unit described in the present 
paper served to' document the effectiveness of the Unit for EMR childr,en, 
and its useablllty in the cJassroom* The field^fest of the Honey Unit 
deuK^nstrated that the Unit did, in fact, significantly increase the EMR 
child *s knowledge of money skills and vocabulary. This Increase was 
greater than that obtained by either a Control group or a Hawthorne control 
group* 

The effectiveness of the Instruction in the toney Unit was supported 
by the pretest and posttest gains, by the performance levels of Individual 
Itess, arid by the retention data. The data from retention testing is of 
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foremost important since they indicate that the EMR children who had 
^received t^e Honey Unit completely retained the skills and vocabulary 

after an interval of two months. \ 

Analyses of coranunity locatidn effects indicated that the Unit was 

highly effective in rural and suburban coimunities , as well aa in the 

urban communities (the setting in which the materials were developed, 

V ^ * ' \ 

pilot-tested, and revised). The finding that the rural C'pntrols performed 

i 

significantly better than their urban and suburban counterparts suggested 
that these Control teachers might be engaging in special procedures or 
using special materials to teach money concepts to tKeir children. When 
the Control teachers were asked to describe the money instruction they 
had used, if any, all f esponded** that they had taught money • All teachers 
indicated that they had used materials they had developed themselves in 
addition to soine worksheets and manipulable materials from published 
curriculums. Six of the teachers gave an estlinate of the total number 
of days they had spent on money instruction. The three suburban teachers 
averaged 11 days, the two urban teachers averaged 9 days, and the one 
rural teacher taught money for 32 days during the year" (the other rural 
teacher indicated that instruction was given individually so that children 
dpent ^'as much time as they needed" receiving money instruction). 

The useabllity of the Money Unit was also documented as a result 
of the present summative evaluation. All of the teachers who used the 
Money Uniu indicated that they liked it and would prefer using it to 
other instructional materials. Most of the teachers thought the materials 
offered more diversity than mp^t other materi^j, and were more useable,^ * 
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effective and enjoyable than other conEierical luaterials they had used 
before. Also, the teachers f^t .that the concepts covered in the Money 
Urtlt were Important and necessary in the long run. 

The Money Unit presents money skills and vocabulary which have been 
identified as important to the normal development of any child, especially 
the young EMR child (cf , , Kolstoe, 1970; Nuffield, 1969; Peterson, 1973). 
The pretest data from the present. field-test and from the formative 
evaluation of the Money Unit (of,, Thurlow, Krus, Howe, Taylor, and 
Tumure, 1974) indicated that these money concepts* while important for 
all children to learn, are particularly difficult for retarded ohildren 
to master without instruction. The summative evalaa.tion of the Money 
Unit has demonstrated its effectiveness and useability in the classroc*. , 
and has verified the belief that the Money Unit fulfills an Important 
need in the education of the yoiing EMR child. 
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Footnotes 

/ 

i 

*The susmativa evaluation of the Money Unit was an extensive 
endeavor - couid not have succeed without the help and 
cooperation of niany individuals. Appreciation is extended to all 
school sv^Sms participating in the field-test* and esoeciallv to 
the teaehers who allowed a great deal of testing and who responded 
willingly to all requests made of them. Special thanks are due 
to Joni Blumenfeld Troup, who scheduled and completed all testing, 
and wlio formed the major link between the Project and the teachers 
in tKe field te^t, 

2 

"Arthur M. Taylor is now Supervisor of Programs for the Mentally 
Retarded in the St, Paul Public Schooi-^item, His address is; 
Special Education Department, MR Progr|m, St. Paul Public Schools, 
360 Colbo^n^, St. Paul, Minnesota 55103. 
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Unit Evaluation 



41 



i* Whare did you start teaching in the Money Unit? 
2 
1 



Where did you stop teaching in the Honey Unit? 



Book 



Book 



Please indicate: 

a. The average preparation time for each teaching period: 

b. Ihe average length of each teaching period: minutes 

c. The average number of teaching periods per five day week: 



Lesson_ 
Lesson 



minutes 



Please indicate the percentage of time in which instruction was given to: 

Wiole class % 

Small groups % 

Individuals % 



How did you feel about using the Honey Unit? 

I enjoyed it very mxch 

I thought it was alright 

I would rather use something else next time 

Have you used any other coisnerclal materials or inath texts to teach 
money concepts? ____ YES 

If YES, what 4id you use*? ™" 



NO 



a* If given a choice of materials to use to teach money: 

. I would prefei; to use this Money Unit rather than others 

, I would use either this Money Unit or other money 

materials; wouldn't matter 

I would prefer to supplement this Honey Unit with other 

materials 

I would prefer to use other materials all together 



b, Con^ared to other comercial materials, was the Honey Unit 

More useable? ^ YES 

More effecti\re; YES 

More enjoyable? YES 



NO 
NO 
NO 



3, -*Did you get tired of teaching with these materials? 

Yes, the repetiveness was boring 

Sometimes, but the repetiveness is necessary 

to teach my students 
^ No, these materials offer more diversity than most 
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4. How Import ant do you think the concepts covered in the Honey Unit are to the 
children in the long run? 

All concepts are essential 

Moat concepts are necesssary 

Concepts are good, luc not necessary 

Hoht: concepts are not needed 

5» Do you think the children will remember the more important money concepts 

a year from now? YES NO 

6* How effective were the materials: 

Very effective 

Effective 

Could have been more effective 

Hot very effective at ail 

7* How interested were the children in the Money instruction? 

More Interested than usual 

^ About as interested as in other instruction 

Hoc very interested ' 



Please rate the following aspects of the Honey Unit in terms of their appropriate- 
ness (or, completeness)* for you as the teacher . Rate each item from 1 to 5, with 
1 being the least appropriate <or^ complete) ard J being the most appropriate ^(or, 
complete)* 



a. Inservice training 



b* Teacher *s Editions, in general 



c* Introductory pages to Teacher* 3 Editions 



d. Directions to teacher in lessons 



e. Pre^actlvitles 



f* Lesson Organizers 



g* Scripts accompanying tape presentations 



h, Pos reactivities 



i. Worksheets 




4 

J * 



Transparencies 
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Please rate the following aspects of the Money Unit in tenns of their 
effectiveness > enjoyability , interest, and attentions-focusing ability, 
for the children in your classroom. Rate each item from 1 to 5, with 
1 being the least effective (enjoyable, interesting, or attention-focusing) 
and 5 being the most effective (enjoyable, interesting, or attention- 



focusing) . 




a. Introductory lesson (for preparation) 



b. Mr. Mom^y 



c, Pre-activities 



d. Tape recordings 

^ 

e. Worksheets 



ft Transparencies 



g» Art work in books, worksheets, etc* 



h. Post-activities for review 



1. Post-activities to expand concepts 



j. Post-activities to build skills 



Did you have any problems with the pre-- testing and/or 

post- testing of tne unit? ' VES 

If YES, what were the problems? 



Where dla the pre-^test results suggest that you start 

teaching the Money Unit? Book _^_Lesson 

Did you agree with the rcconmiended starting point? YES NO 

Did you teach all the lessons between the points at 

which you started and stopped inrs traction? YES NO 

If NO, what did you skip? 



At what mental age would you recommend that children 
could start in the Honey Unit? 



6. 



Are there any children for whom you feel the Money Unit is not appropriate? 



7. How long do you think it would take your children to complete the entire 
Money Unit? 



8. Kow long do you think it would take your children to cover the same content 
as presented in the Honey Unit, without the use of the program? 



9. Which of the following teacher-^administered assessment devices would you 
like to see added to the Teacher's Editions to evaluate the children's 
progress? 

Lesson tests 

Book tests 

Unit tests 

Hone 



1* Look at the sequence of the entire Honey Unit* Is there any 

way you would change the sequence? "^'ES NO 

If YES, how? ™ ™ 



2, How do you feel about the completeness of the Honey unit? 

. Needs more instruction at the beginning 

Needs more instruction at the end 

^„ Unit is complete as it is 



Frequently, when a new program of instruction is introduced into a classroom, 
other individuals see and react to the materials. Please rate the reactions of 
any of the following individuals to the Money materials, on a scale of 1 to 5 
(1 » negative reaction; 5 » positive reaction)* 

Principal 

____ Parents 

Regular classroom teachers 

Aides 
Others 



Please indicate: 

a* Number of years of teaching experience (include all teaching 
except student teaching) 

b. Number of years teaching educationally handicapped children ZZZ^IZl 

c. Are you certified in special education? YES NO 



If you have the time and the inclination, are there any suggesticns about the 
testing or the n^terials you would like to share with us? 



Is there anything else you would like to tell us? 
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And, a FEW more geiK^ral questions 

These questions have "poppe<f*up as a result of some comments we have received. 
Please let us know how you feel. 

Do you think the Money, Measurement and Time Program should be modified into a 
program of individualized instfuction? 



!• . Did you like using the Big Picture Book? Please note any suggestions 

you have for making the Big Picture Book more useable and/or more affective. 



2, Did you like the children to have their own texts? Please note any 

suggestiotis you have for making the Children's Picture Books more useable and/or 
more effective* 



3* How do you think the student texts should be supplied to the classroom? 

Only in the form of Big Picture Book? 

_____ Only in the form of individual Children's Picture Books. 
In both forms, with both being used during the same 

tape presentation 
In both forms, with the teacher selecting the form to be 

used during a given tape presentation 
_____ In one form for certain books and the other form for other 

books (l*e,, as it is now) 

4. What do you think would be the most effective and useful way to *lnf arm the 
teacher of the content of the tape presentations? 

______ Complete script (i.e*, as is) 

Summary of script 
No script at all 



Please describe the room arrangement you nsed during the tape presentations (e*g., 
children on floor around tape player, children at desks with tr-e player in frrnt 
of room^ etc.)- Draw a diagram if this will clarify your response-* 
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Is there any other room arrangement you think would be best for optimizing the 
effectiveness of the tape presentations? 



What do you feel would be the best way to introduce a unit in the Money, Measurement 
and Time Program to a teacher planning tc use it in the classroom? 

Inservice training session 

^Written document describing unit flow, books, etc. 

Both inservice training and written document 

The Teacher ' s Introduction to the Mdney, Measurement and Time Program was designed 
to familiarize the teacher with the total program. Please briefly describe your 
reactions to the Teacher *s Introduction and any recommendations you have for 
improving it* 
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Appendix 2. Teacher Evaluations of the Money Unit, 



A, 



Teacher Character in tics 
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1* Number of years of teaching experience 
(all teaching except student teaching): 



2. Number of years teaching educationally 
handicapped children: 



X » 6*7 years 
SD = 7.2 
Range: 1-25 

X 5,4 years 
SD - 5,4 
Range: O^-IS 



3. All 10 teachers are certified in special education. 
Teaching Characteristics 



1, Average preparation time for each teaching 
period : 



2, Average length of each teaching period; 



3* Average number of teaching periods per 
five day week: 



X * 15*2 minutes 
SD * 8,6 

Range: 5-30 minute^ 

X « 25*0 minu.tes 
SD « 6.2 

Range: 15-20 minutes 



X = 4,9 
SD « 2*0 
Range: 3-10 



4* Room arrangements (asked of only 4 teachers): 

a, "Children on floor around tape player with book on chart 
stand in front of them*" ^ - 

b, "Children on floor." 



X X X X X 
X X 

tape recorder, x x 
and book over 
back of chair 

c* "Children would sit on floor around me and the big ' 
picture book." 



X - teacher 



d. 



All on floor 



X X 
X X 
X X 
K X K X 



WTE : None of the teachers asked felt any other room arrange- 
ment would be more appropriate. 



General Reactions to the Money Unit 



Iteta : "Hw did you feef about usirig- the Money Unit?** 

100% "I enjoyed it'very much" 

0% "I thought it was all right'' 

0% "I would rather use something else next time/' 



1 t^ : "Did you get. tired of teaching with these materials?" 

0% "Yes, the repetiveness was boring." 
50% "Sometimes, but the repetiveness is necessary 

to teach my students** 
70% "No, these materials offer more diversity 
I than most" ^ 

^ 

NOTE ; Two teachers marked both ^ the second and third choices, 
one Indicating that second choice was appropriate 
for her younger group and third choice for *her advanced 
group. Another teacher indicated that' even if 
sometimes b%fcam€ bored, the children never did. 

3» Item ; 'How Important do youv think the cRicepts covered in 
the Money Unit are to the chUdran in the long run?" 

70% "Ail concepts are essential" 
30% **Mo8t concepts are necessary" 
.0% "Corrtiepts are good ^ but not necessary? 



\pt' ^'Most concepts are not neede4" 

Item: *'Do you think the children wtll remember the more 
important money concepts a year from now?"^ 

100% Yes 0% No 

Item : "llow effective were the materials?" 

60% "Very effective" 
40% "Effective" 



0% "Could l^ve been more effective" 
0% "Not very effective at all" 

6, Item ; "How' interested were the children In the Honey Instruction 

90% **More interested than usual" r 
10% "About as interested as in other instruction" 
0% "Not v^ry interestedf^ 
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D. Answers to Specific Questions 

1. When asked to nan^ other materials the teachers had used to 
teach money, the following were noted 5 

K 

Houghton Mifflin (3 tethers mentioned this text) 
Silver Burdetfc (Book 1) ^ 
Money Sense 

Individually written units 
District sheets 
N , Manipulative devices 

Continental Press (commercial dittos) 

Of th% six teachers who indicated -they had used other materials 
to^ teach money, the following reactions were given: 

83% "I would prefer to use this Money Unit rather' 
than others** 

0% "I would use this Money Unit or other money 

materials; vK)uldn*t matter" 
33% "r would prefer to Supplement this Money .^nit 
witJi other materials'* ^ 
0% "I would prefer to use other materials all to- 
gether** 

.Mf' 

NOTE: One tether mark^ both the first and the thJLrd choices. 
Ho explanation was given ♦ 



When asked to compare the Money Unit to other coimiierclal mater- 
ials they had used, the Money Unit was rated as: 



More usable? 



100% Yes 



More effective? 100% Yes 
More enjoyable? 100% Yes 



OX No 
0% No 



0% No 



It^ : **At what mental age would you recosmiend that children 
could start in the Money Unit?" 

(7 responses) X « 5.0 

SD - 0*8 
Range ^ 4-6 

Item: **Look at the sequence of the entire Money Unit* Is 
there any way you would change the sequence?'* 

0% Yes 100% No 
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Item : **How do you feel about the completeness of the Honey 
Unit?" 

0% **Needs more instruction at the beginning" 



20% *^eeds more Instruction at the end" 



60% ^TJnlt is complete as it is** 

NOTE ; One teacher indicated she sould like more tapes deal- 
ing with **counting various coin^,^**. 

it I 



Whett asked to race the reactions of othef 'iiWivlduals to the 
Money materials, the following were given: 
(Rating is on scale of 1 to 5 from most^gative r<?action to 
ffi03t positive) ^ 

4>4 Principal (n-5) 

4,8 Parents (n«7 

4*8 Regular, classroom teachers (n='7) 

5.0 Aides (n=»6) 

5,0 Others (n=2) 

item: "Which of the following teacher-^adminlstered devices 
would you like to see added to the Teacher's Editions 
to evaluate the children ''s progress?" 

40% Lesspn' tests 
70% Book tests 
60% Unit tests 



0% Hone 



WTE: Host teachers responded more than once* One teacher 
not marking a specific choice indicated that there 
should be tests rafter "every few" lessons, 

Itm : "Are there any children for whom you feel the Honey 
Unit is not appropriate?" 

Responses : 

"I feel that some childfen in my room were not 
ready for" 

"All children get something of value from most of 
the Unit but last part of IBook IV is too difficult 
for all but a few." 

"I believe Books 1 6t 2 are appropriate for any 
child, but Books 3 & 4 should only be taught 
to those who understand numbers 1-100," 
"No" (teachers) 

"Some could not handle it in a group situation," 
"Yes, after the exact value of che coins," 
"No, I fdlt all my children needed the unit," 
"Those that have no interest in learning money," 

Item ; "How long do you think it would take your children to 
complete the entire Money Unit?" (a) "How long do you 
think it would take your children to cover the same con 
tent as presented in the Money Unit, without the use 
of -the program?" (b) 

(a) (b) 
4 'months NR 
16 weeks ? 
3'-4 months 1 year 

6 months a lot longer 

4 months; some shorter will vary 2-6 months 



(a) (cont.) 
Couldn't complete because 

of ability levels 
2 years (because of 

math ability) 

1 full year 
about 3 months 



4-6 months 



(b) (cont. ) 
NR 

"With a comparable buildup 

of skill It should be' 

equal . " 
"It would be hard to say" 
"A lot longer to cover 

content and understand 

it - 6 months" 
"Forever!" 



Teacher Reactionar to Specific Aspects of Money Unit (mean rating 

on scale of 1 to 5, from negative to positive; the number in paren- 
theses is the n) - , 

c Appropriateness Completeness " Average 



1. 


In-service training 


3.9 


.(8) 


3.7 


(9) 


3.8 


2. 


Teacher's Editions, general 


5.0 


(9) 


5.0 


(30) 


5.0 




Introductory pages 


4.3 


(10) 


4.4 


(10) 


4.4 


4. 


Directions to teacher in 














lessons 


4.7 


(10) 


5.0 


(9) 


4.8 


5. 


Pre-Actlvlties 


4.8 


(10) 


4.7 


(9) 


4.8 


6. 


Lesson Organizers 


4.7 


(10) 


4.7 


(9) 


4.7 


7. 


Scripts for tapes 


4.9 


(10) 


4.9 


(9) 


4.9 


8. 


Post-Activities 


4.7 


(10) 


4.2 


(9) 


4.5 


■ 9. 


Worksheets 


4.2 


(10) 


4.. 3 


(9) 


4.2 


10. 


Transparencies 


4.5 


(10) 


4.2 


(9) 


4.4 



Children Reactions to Specific Aspects of Money Unit (mean ratlng^ by 
teacher on scale of 1 to 5 > fro^a negative to positive^ all 10 teachers 
responded to every item) * 

Effective- Enjoy-- Interest Attention Average 







ness 


ability 




Focusing 




1. 


Introductory Lesson 4*8 


4.8 


4.7 


4.7 


4.8 


2. 


Mr, Money 


\.9 


4.9 


4.9 


4.9 


4.9 


3. 


Fre--Activitlss 


4.7 


4i4 


4.5 


4.6 


4.6 


4. 


Tapes 

* 


4.8 


'',9 


4.6 


4". 6 


4.7 


5. 


worksheets 


4.2 


4.1 


, 4.0 


4.2 


4.1 


&. 


Transparencies 


4.0 


3.9 


3.8 


4.0 


3.9 


7 

f ♦ 


Art Work 


4.x 


4.2 


4.1 


4.0 


4.1 


8. 


Post Acts: Review 


4.8 


4.5 


4.4 


4.5 


4.6 


9. 


Post Acts: Expand 


4.5 


4.5 


4.4 


4.3 




10. 


Post Acta: Skills 


4,5 


4.5 / 


4.4 


4.4 


' 4.4 



Specific Questions about Materials in general (asked of 4 teachers 
only) 



1* I_tem: *'Did you like using the Big Picture Book?" 

100% Yea 0% No 

''Did you like the children to have their own texts?" 

331 s 66% No (3 responses, one teacher did 

not use them) 

Specific Comments: 

'One large teacher book for all to focus upon seems more 
reasonable for young and distractible children/* 
.ke the big picture much better than the Individual 
booKS. Much easier to hold classes attention th 
big looks; didn^t use individual books/' 
"It would be helpful If it [Big Picture Book] could stand 
up without . olding it/* 

" '''^'O^ yon think the student tex's should be supplied 
to the classrooiti?*^ 

0^ ''Only in the form of Big Picture Books/' 
„.^^L **Qnly in the form of individual Children's Picture 
Books" 

'^In both forms, with both being used during the 
same tape presentation" 

both forms, with the teacher selecting the 
form to be used during a given tape presentation/' 
Jl^±. '^^^ form for certain books and the other 
form for other books (i.e., as it is now)" 

^ L^^' ''What do you think would be the most effective and 
useful w^ay to inform the teacher of the content of 
the tape presentations?" 

100% Complete script (as it is) 
0% Simmiary of script 



_0% No script at all 

LL^B- '^^^ think the Money, Measurement and Time Program 

should be modified into ^ program of individualized 
inst? ction?" (1 no response) 

"N!o, teacher can individualise herself as she sees 

fit - the children need some whole group instruc- 
tion/' 

*'Yes- Tne beginning works fine in a gro- p, but when 
the money counting begins - it almost has to be 
completely one to one/^ , 



5. Item: 'Vhat do you feel i^uld be the best way to Introdurp 

a unit in the Money, Measurement and Time Program to a 
teacher planning to use it in the classroom?" 

,25% iH'-service training 

0% Written doci^ent describing unit flow, books, etc 
7*"% Both in-service craining and written document. 

Teacher Cc^ients (ones not specifically elicted by questionnaire) 

1* eliminated some post-activities that were too difficult 

(counting by 5's for example) - I went ahead and taught value 
of half dollar." 

2. *I loved ceaching the unit and hope to do it again - I think I 
could do better next time but felt very comfortable teaching it. 
I can hardly wait to start measurement-" 

3. "More tapes for post-activicies . Children enjoy them and learn 
from them* This has been an enjoyable experience of practical 
value to the youngsters. I appreciate very much the opportunity 
of using these materials and I extend my thanks for being 
allowed to keep them. 

"I realize my comments have not been specific, but the unit 
is so complete it is difficult to pinpoint spots where it could 
be improved. However » I believe more tapes would be ^-Ipl-ai. 

"Tha coins on the worksheet are not clearly picti .ed and 
there was often confusion between the nickel and quarter as 
children worked on them. 

"Unit tests as parts were completed would also h*j helpful." 

4. would recommend that the children have concepts of the 
numbers 1-lOC before starting this program," 

5. "It was an absolute pleasure to teach this unit! Everything 
was all together and o organized, I didn't have to search 
an>'where for supplementary materials , like I usually do!" 

6. "I knew this unit really worked when a mother mentioned at 
conferences that *How he asks for dollars. He used to ask for 
nickels and dimes!* Hal" 

7. "I as very pleased with the entire money unit* I only wish 
I .ould have finished it this year. The class wds very 
enthusiastic about 'Mr. Money, ^ It was a time during the day 
that they looked forward to, 

"I felt they (children) learned and retained most of the 
concepts presented, X am looking forward to the results of the 
post--tests 

8. "I think some provision must be made for individual differences." 

9. "It was very hard for my students to recogni^^c coins on the 
workaheets. It would be nice to fiave pictures of actual coins 
instead of illustrations," 

0, 'My children lost interest after a month or so because of the 
same pattern followed in the lessons* The Idea of giving each 
student his own workbook restored interest." 



!!• "[To start Money Unit^ the children] must have some number 
ability - and interest in nusney/' 

12, "I foimd the program easy to conqjrehend* The problems that 
came up had nothing to do with your program content - But 
rather with students time to do activities* We do much inte- 
gration so there was no chance to do the unit daily/* 

13. "1 really enjoyed the organization of the lessons and the 
children loved Mr, Honey 

14* "Add more v^rksheets. The kids enjoy the unit money is 
s highly motivating subject, 'they really liked Mr, Money 
and the pictures. The organization is great! I never could 
have taught such a chorough unit, M^' kid's parents have even 
m^de positive reiaarka about their c^,lldren*s progress*" 
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